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Abstract 


'~Hhe  purpose  of  this  paper  is  to  present  an  accelerate^lgorithm  for 
solving  0-1  Positive  Polynomial  (PP)/ problems  of  finding/^ 0-1  vector  x 

..I"'  / 

that  maximizes  cx  subject  to  f(x)  <b,  where  f(x)  =  {^l(x))  an  m-vector 


of  polynomials  with  nonnegative  coefficients.  Like  our  covering  relaxation 
algorithm  (1979)  the  accelerated  algorithm  is  a  cutting-plane  method  in  which 
each  relaxed  problem  is  a  set  covering  problem  and  the  cutting  planes  are 
linear  covering  constraints.  However  by  contrast  with  other  cutting-plane 
methods  in  integer  programming  (including  our  original  method),  we  do  not 
solve  the  relaxed  problems  to  optimality  after  the  introduction  of  the 
cutting-plane  constraints.  Rather,  we  first  solve  each  relaxed  set-covering 
problem  heuristically  and  only  if  the  heuristic  solution  is  feasible  for 
PP  do  we  solve  the  relaxed  problem  to  optimality.  The  promise  of  such  an 
approach  stems  from  the  excellent  performance  of  the  various  heuristic 
algorithms  for  solving  integer  programs.  Indeed  the  extensive  computational 
experimentation  we  performed  reveals  that  the  accelerated  approach  has  reduced 
significantly  both  the  number  of  covering  problems  solved  to  optimality  and 
the  computational  time  required  to  solve  a  PP  problem.  For  example  the 
average  computational  time  required  to  solve  a  PP  problem  with  40  variables 
and  an  average  of  10.5  terms  per  constraint  and  3  variables  per  term  was  reduced 
using  the  accelerated  method  from  84.7  to  25.8  seconds  while  the  average  number 


i 


1. 


1 .  Introduction 

We  consider  in  this  paper  the  0-1  positive  polynomial  (PP)  problem  of  finding 

a  0-1  n  vector  x  =  (x.)  that  maximizes  cx  subject  to  f(x)  <  b  where  c  =  (c.)  and 

J  p.  J 

b  =  (b.)  are  non-negative,  f(x)  *  (f.(x))  where  f^(x)  =  Xj  with  a^,^  >0 


and  N|^  c  N  =  {1,2,. ...n}  for  each  1  <  k  <  p^  and  ieM  =  {1,...,m}. 

Polynomial  terms  in  0-1  variables  have  been  found  to  be  extremely  useful  in 
modeling  diverse  problems  in  business  and  engineering.  They  are  used,  e.g.,  when 
formulating  media-selection  problems  [27],  to  incorporate  risk  into  capital  budget¬ 
ing  [18],  for  planning  of  irrigation  systems  [17],  in  cluster  analysis  [20],  and 
in  various  scheduling  problems  [13,19] 

The  two  major  approaches  proposed  in  the  literature  for  solving  PP  problems 
are:  the  linearization  approach  and  the  Boolean-algebra  approach. 

In  the  linearization  approach  [8,9,26]  each  distinct  polynomial  term  is 
replaced  by  a  new  variable,  and  additional  side  constraints  are  introduced  to 
ensure  that  the  values  of  the  term  and  the  variable  replacing  it  coincide.  The 
main  drawback  of  the  linearizaton  approach  is  the  radical  increase  in  the  size  of 
the  linear  0-1  problem  obtained.  An  implicit-enumeration  algorithm  for  solving 
the  transformed  linear  0-1  problem  in  which  the  additional  side  constraints  intro¬ 
duced  by  the  linearization  are  considered  only  implicitly  was  developed  by  Taha 
[22,23].  His  computationalexperiments  reveal,  though,  that  such  an  approach 
could  solve  only  very  modest  size  problems. 

Using  Boolean-algebra  techniques,  F.  Granot  and  Hammer  [12]  have  shown  con¬ 
structively  that  every  PP  problem  is  equivalent  to  a  linear  covering  problem  in 
the  complementing  0-1  variables.  They  have  further  suggested  an  algorithm  for 
solving  the  PP  problem  that  generates  the  equivalent  linear  covering  problem 
and  then  solves  it  by  available  methods.  Unfortunately,  an  attempt  to  solve 


PP  problems  along  the  above  lines  failed,  mainly  due  to  the  large  number  of  con¬ 
straints  in  the  equivalent  linear  covering  problem.  In  [10]  Granot  et  a1.  have 
developed  a  covering  relaxation  method  for  solving  PP  problems.  This  method 
produces  an  optimal  solution  to  PP  by  solving  a  nested  sequence  of  linear  set¬ 
covering  problems,  each  of  which  is  a  relaxation  of  the  original  PP  problem. 
Computational  results  reported  in  [10]  indicate  that  the  covering  relaxation 
approach  is  a  viable  method  for  solving  modest  size  sparse  PP  problems.  However, 
an  increase  in  the  density  of  PP  (i.e.,  in  the  number  of  distinct  polynomial  terms 
in  each  constraint)  significantly  increases  the  number  of  covering  problems  required 
to  be  solved,  which  in  turn  results  in  excessively  high  computational  times. 

The  purpose  of  this  paper  is  to  accelerate  the  performance  of  the  covering 
relaxation  algorithm  by  reducing  the  number  of  covering  problems  solved  to  opti¬ 
mality.  Both  the  covering  relaxation  and  the  newly  introduced  accelerated  method 
are  cutting  plane  algorithms  in  which  relaxation  is  achieved  via  the  set-covering 
problem  and  the  cutting  planes  are  linear  covering  constraints.  However,  in 
contrast  with  other  cutting-plane  methods  in  integer  programming,  we  do  not  solve 
the  augmented  problem  to  optimality  after  the  introduction  of  the  cutting-plane 
constraints.  Rather,  we  first  solve  the  augmented  covering  problem  heuristical ly, 
and  only  if  the  heuristic  solution  is  feasible  for  PP  do  we  solve  it  to  optimality. 
The  promise  of  such  an  approach  stems  from  the  excellent  performance  of  the  various 
heuristic  algorithms  for  solving  integer  programming  problems,  see,  e.g.,  [3,6, 
14,15,21,24].  Indeed,  the  extensive  computational  experiments  we  performed,  which 
are  reported  in  section  5,  show  that  the  accelerated  approach  has  reduced  both 
the  number  of  covering  problems  solved  to  optimality  and  the  computational  time 
required  to  solve  a  PP  problem  by  over  70%.  This  reduction  enabled  us  to  solve 
PP  problems  with  a  larger  number  of  polynomial  terms  in  each  constraint.  For 
example  nine  out  of  ten  PP  problems  with  40  variables,  40  constraints  in  which  the 
number  of  terms  per  constraint  is  uniformly  distributed  between  1  and  30  were 


solved  In  less  than  200  seconds.  The  average  CPU  time  required  to  solve 
those  problems  was  64.2  seconds  while  the  number  of  covering  problems  solved 
to  optimality  was  on  the  average  4.8. 


2.  The  Accelerated  Covering  Relaxation  Algorithm 

We  start  by  presenting  a  general  framework  for  our  Accelerated  Covering 
Relaxation  (ACR)  algorithm  for  solving  PP  problems.  This  is  followed  by  a  de¬ 
tailed  description  of  the  various  steps  in  the  algorithm. 

The  ACR  Algorithm 

Step  0.  Generate  an  initial  linear  covering  problem  that  is  a  relaxation  of'PP, 
to  be  referred  to  as  the  covering  relaxation  (CR)  problem. 

Step  1.  Solve  CR  heuristically,  and  let  x  denote  the  heuristic  solution.  If 
X  is  infeasible  for  PP,  go  to  Step  2;  otherwise  go  to  Step  3. 

Step  2.  Generate  covering  constraints  from  violated  polynomial  constraints  at  x. 

Augment  CR  with  the  newly  generated  constraints  to  form  the  new  CR  problem. 
Go  to  Step  1 . 

Step  3.  Solve  CR  to  optimality,  and  let  x  denote  an  optimal  solution.  If  x 
is  feasible  for  PP,  it  is  also  optimal;  otherwise,  go  to  Step  2. 

The  improved  perfonnance  of  the  ACR  algorithm,  when  compared  with  the  cover¬ 
ing  relaxation  method  [10],  is  mainly  due  to  the  addition  of  step  1.  In  the  ACR 
algorithm  we  always  attempt  to  generate  the  cutting  planes  from  the  heuristic 
solution  X  found  at  step  1.  Only  if  this  heuristic  solution  is  feasible  for  PP, 
we  solve  the  CR  problem  to  optimality. 

Propositions.  The  ACR  algorithm  coverges  in  finitely  many  iterations  to  an  optimal 
solution  of  PP. 


Proof.  Optimality  follows  since  each  CR  problem  is  a  relaxation  of  the  original 


PP  problem.  Further,  with  each  application  of  step  2  of  the  algorithm  we  eliminate 
the  current  solution  x  to  CR,  which  is  infeasible  to  PP.  Since  the  number  of  binary 
vectors  is  finite,  the  convergence  follows. 

The  heuristics  algorithms  that  are  used  in  step  1  are  presented  in  the  next 
section.  In  section  4  we  present  various  strategies  for  generating  cutting  planes 
from  violated  polynomial  constraints, which  are  employed  in  step  2  of  the  ACR  algo¬ 
rithm.  We  further  present  there  a  method  for  generating  an  initial  CR  problem. 


3.  Heuristic  Algorithms  for  Solving  Linear  Covering  Problems 

We  develop  in  this  section  four  different  heuristic  algorithms  for  solving 
linear  covering  problems.  In  step  1  of  the  ACR  Algorithm  we  apply  the  four  heuristics 
to  CR,  and  choose  as  the  heuristic  solution  x  the  best  one  produced  from  these  four 
heuristic  algorithms. 

Consider  again  the  covering  relaxation  problem  of  finding  a  0-1  n-vector  x  =  (x^.) 
that  minimizes  cx  subject  to  D.(x)  >  1  for  all  ieM  where  D.(x)  =  L  «a..x.  and  a.. 

1  jcn  ij  j  ij 

is  0-1  for  each  ieM  and  jeN.  We  assume,  of  course,  that  the  CR  problem  is  feasible, 
I.e.,  0.(1)  >  1  for  all  IeM. 

At  eacp  stage  in  the  various  heuristics  there  will  be  a  set  F  of  Indices 
j  of  "fixed"  variables  x.  whose  values  have  been  previously  determined  and  a  set 

J 

l*AF  of  indices  j  of  "free"  variables  whose  values  may  still  be  revised.  To  describe 
the  heuristics,  we  need  a  bit  of  notations.  To  this  end,  let  Mp  «  {i:  IeM  and 

^jcF*ij*j  ^  '^F  ***  indices  j  in  N\F  such  that  Xj»l  and  D|(x)>1 

for  some  i6M\  Mp  with  Denote  by  Pj^Cx)  the  set  of  Indices  j  In  N  for  which 

Xj»k  and  a^j*l  for  some  1  in  M\  Mp  minimizing  0^(x),  for  k«0,l. 


.  (A  primal  greedy  heuristic  that  starts  with  the  Initial  point  x«l 


and  F*J^) 


Step  1.  If  Mp*M  then  x*  is  the  desired  heuristic  solution  where  xj»l  for  jcF  and 


x^»0  for  j^F.  Otherwise 

%} 


-1 


Step  2.  Let  k  be  an  index  j  in  P^(x)\  F  that  maximizes  a^j(D^(x)-1) 

where  ties  are  broken  by  choosing  j  the  smallest  index  that  maximizes  Cj.  Revise 
X  by  reducing  Xj^  to  zero.  Set  F“Fu{k>ujpj^l^j and  go  to  step  1. 

Clearly,  Heuristic  I  will  terminate  in  at  most  n  iterations. 


Heuristic  II.  (A  dual  greedy  procedure  that  starts  with  the  initial  point  x*0  and 
F*0). 

Step  1.  Let  k  be  an  index  j  in  Pq(x)  that  minimizes  m 

where  ties  are  broken  by  choosing  j  the  smallest  index  that  minimize  c..  Revise  x 

J 

by  setting  X|^»l,  and  F  »  PJ{k).  If  Mp^M  go  to  step  1.  Otherwise  put  F  «  {j:  Xj*0}. 
If  FUJp  a  N,  X  is  our  desired  heuristic  solution.  Otherwise  set  F  »  FUJp  and 
go  to  step  1  of  Heuristic  I  or  III. 


Heuristic  III.  The  same  as  Heuristic  I  except  that  the  maximization  in  step  2  is 
done  over  a_n  indices  j  of  free  variables,  and  not  only  those  free  variables  in 
minimal  constraints. 

Heuristic  IV.  The  same  as  Heuristic  II  except  that  the  minimization  at  step  1 
is  done  over  all  indices  j  for  which  x.  »  0. 

w 

Remark  1.  The  reason  for  returning  to  Heuristic  I  or  III  at  the  end  of  Heuristic  II 
is  to  check  whether  some  of  the  variables  whose  values  are  one  can  be  reduced  back 


to  zero. 


6. 


Remark  2.  The  four  greedy  heuristics  developed  above  differ  slightly  from  the 
ordinary  greedy  heuristics  suggested  in  the  literature  for  solving  integer  programs, 
see;  e.g.  [15,21,24].  This  difference  is  due  to  the  fact  that  our  criterion  for 
selecting  the  variable  whose  value  is  either  decreased  (Heuristics  I  and  III)  or 
increased  (Heuristics  II  and  IV)  depends  on  the  weights  D^. (x)  and  respect¬ 

ively.  Dropping  these  weights,  i.e.  choosing  to  increase  or  decrease  the  value  of 
a  variable  in  accordance  with  the  ratio  c^/La. results  with  slightly  inferior 
heuristics,  as  exhibited  in  section  5  table  5.  Similar  conclusions  were  independently 
reported  in  [16]. 


f 
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4.  Generating  Covering  Constraints 

In  this  section  we  present  various  strategies  for  generating  covering  constraints 
from  violated  polynomial  constraints.  These  strategies  are  employed  in  step  2  of 
the  ACR  algorithm. 

Let  X*  denote  either  a  heuristic  or  an  optimal  solution  to  the  current  CR  problem 
and  let 


X,  <  b 


be  any  polynomial  inequality  derived  from  a  violated  constraint  of  PP  at  x*  »  1-x* 
after  dropping  the  vanishing  terms  at  x*,  i.e.,  *  Z^sia^  >b.  Further, 

let  S  c  N  be  such  that  >  b  and  its  corresponding  covering  constraint 


>  ' 

where  |S|  is  the  cardinality  of  S.  Clearly,  when  (2)  is  added  to  the  constraint 
set  of  CR  it  eliminates  x*.  In  fact  (2)  eliminates  0-1  vectors  from  the 

feasible  set  of  CR  (some  of  which  might  have  been  previously  eliminated  by  other 
covers),  and  it  seems  plausible  therefore  that  a  best  covering  constraint  (2)  that 


can  be  produced  from  (1)  Is  one  in  which  |S|  is  minimal.  Moreover,  choosing 
covers  with  minimum  cardinality  will  produce  covering  problems  with  lower  density 
which,  in  turn,  will  decrease  the  computational  time  for  solving  a  PP  problem. 

For  this  reason  we  have  developed  an  implicit-enumeration  algorithm  for  generating 
a  cover  with  minimal  cardinality.  In  this  algorithm  we  associate  with  each  term 
®  variable  y . ,  and  search  for  a  set  I  for  which  >  b  and  N^l 

is  minimum. 

When  the  number  of  terms  in  a  constraint  is  large,  finding  a  cover  with 
minimum  cardinality  may  require  excessive  computational  time.  In  this  event  one 
can  use  the  following  two  greedy  heuristic  methods  for  generating  good  covers. 


I.  The  Ordinary  Method 

Assume  that  a^.  1=1.....  p'-l  in  (1),  and  let  S  =  where  t  is 

the  smallest  index  for  which  >  b.  Then,  the  cover  produced  by  the  Ordinary 

Method  is  T.  S.  >  1. 

^jcS  j 


II .  The  Weighted  Method 

Assume  that  a^/|N. |  >  a.^^/lN^+1 1 ,  i=l ,. . . ,p’-l ,  and  let  S  =  where  i 

is  the  smallest  index  for  which  I^sia^  >  b.  Then  the  cover  produced  by  the 
Weighted  Method  is  ^ 


Remark  3.  Let  >  1  be  the  cover  produced  by  the. weighted  method  and  let 


I  *  {i:  N^cS}.  Clearly,  [^j.ja.  >  b.  However,  one  can  easily  construct  examples  for 
which  the  set  I  produced  by  the  weighted  method  strictly  contains  a  subset  I*  of  I 
such  that  aj  >  b.  That  is,  the  cover  produced  by  the  weighted  method  can  be 
strengthened. 


Remark  4.  Let  >  1  be  a  cover  produced  by  the  ordinary  method.  Then  one 

can  easily  construct  examples  in  which  the  subset  S  produced  by  the  ordinary  method 
strictly  contains  a  subset  S'  of  S  for  which  ^  *  cover  of  the  polynomial 


inequality  (1). 


Example 

Consider  the  polynomial  inequality 

Then,  the  ordinary  method  produces  the  cover  +  x^  +  x^  +  x^  <  3,  the  weighted 
method  produces  the  cover  X2  +  x^  +  x^  +  x^  <  3,  whereas  the  minimum  cardinality 
covers  are  x^  +  X2  +  x^  <  2  and  x^  +  x^  +  Xg  <  2. 


Generating  the  Initial  CR  Problem 

The  initial  CR  problem  used  in  the  Covering  Relaxation  algorithm  [10]  is  the 
unconstrained  0-1  problem  of  finding  a  0-1  vector  x  minimizing  cx.  The  optimal 
solution  is  x=0.  Clearly,  any  subset  of  the  constraints  of  Granot  and  Hammer's 
equivalent  covering  problem  [12]  can  be  used  as  the  constraints  of  the  initial 
CR  problem.  In  step  0  of  the  ACR  algorithm  the  initial  CR  problem  is  produced  by 
employing  F.  Granot's  [11]  efficient  greedy  heuristics  for  solving  PP  problems. 

This  choice  of  an  initial  CR  problem  was  found  to  reduce  the  number  of  iterations 
as  well  as  total  computational  time  required  to  solve  a  PP  problem.  Explicitly 
let  X  designate  a  heuristic  solution  to  PP  obtained  by  using  any  of  the  methods 
in  [11]  and  let  T(x)  =  {j:  x.=0}.  For  each  jeT(x)  denote  by  PP*^  the  polynomial 

V 

problem  obtained  by  substituting  X|^=0  in  PP  for  all  kET(x)\{j).  Further,  let  F'^  be 
the  collection  of  covering  constraints  derived  by  generating  one  covering  constraint 
from  each  violated  polynomial  constraint  in  PP"^  using  the  ordinatry  method.  The 
initial  CR  consists  of  all  covering  constraints  i'’  ^jeT(x)^^‘ 

One  can  advance  the  following  Intuitive  argument  for  explaining  the  effective¬ 
ness  of  using  this  initial  CR  problem  in  step  0.  Any  heuristic  solution  x  produced 
by  the  greedy  methods  in  [11]  is  a  near-optimal  solution  for  PP,  and  Is  In  fact  quite 
frequently  optimal.  Therefore,  the  set  of  covering  constraints  in  the  initial  CR 


y. 


problem  and  hence  in  every  subsequent  CR  problem  tends  to  form  a  fairly  tight 
relaxation  of  the  feasible  set  of  PP  in  the  neighbourhood  of  its  optimal  solution. 


5.  Computational  Results 

Our  algorithm  was  coded  in  Fortran  IV  and  tested  on  an  AMDAHL  470  V-6 
computer  model  II  using  the  IBM  optimizing  compiler.  It  was  tested  on  randomly- 
generated  problems  that  were  generated  as  follows. 

The  cost  vector  c  was  dete'rmined  by  setting  Cq  =  1  and  c^^^  =  c^  +  c  where  c 
is  uniform  on  [0,10],  Every  constraint  is  of  the  form 
P  e 

where  the  number  of  terms  p  is  uniform  on  [1,P];  the  number  of  variables  e  in  each 
term  is  uniform  on  [1,E];  a.,  is  uniform  on  [1,20];  R.  is  uniformly  chosen  between 

I J  I 

1  and  n;  o  is  a  constant  between  0  and  1  that  measures  the  tightness  of  the  con¬ 
straints;  the  right-hand  side  b.  is  chosen  to  equal  a  ?  a.,  (we  have  o  =  0.5  in 

’  j=l 

all  problems  reported  since  for  that  choice  of  a  the  PP  problems  are  the  most 
difficult  to  solve  [10]);  m  is  the  number  of  constraints  and  n  is  the  number 
of  variables.  Some  specific  test  problems  can  be  found  in  [25]. 

The  various  modifications  that  were  introduced  in  sections  2,  3  and  4  to 
accelerate  the  performance  of  the  covering  relaxation  algorithm  [10]  are  primarily 
designed  to  reduce  the  number  of  covering  problems  that  have  to  be  solved  to 
optimality.  In  order  to  evaluate  their  effectiveness,  therefore,  we  should  test 
the  performance  of  the  ACR  algorithm  on  PP  problems  whose  optimal  solution  was 
produced  by  the  covering  relaxation  algorithm  at  the  cost  of  solving  relatively 
many  covering  problems  to  optimality. 

The  extensive  computational  experiments  performed  in  [10]  have  revealed  that 


the  dominant  factor  affecting  the  number  of  iterations  (i.e.,  number  of  cover¬ 
ing  problems  solved  to  optimality)  in  the  covering  relaxation  algorithm  is  the 
maximum  number  of  polynomial  terms  P  in  each  polynomial  constraint.  An  increase 
in  P  increases  very  significantly  the  number  of  iterations  (and,  of  course,  there¬ 
fore  the  computational  time).  On  the  other  hand,  an  increase  in  the  number  of 
variables  n  has  no  significant  effect  on  the  number  of  iterations.  Clearly,  how¬ 
ever,  an  increase  in  n  significantly  increases  the  computational  time,  but  this 
is  mainly  due  to  the  increase  in  the  number  of  variables  n  in  the  covering  problems 
which  become  therefore  much  more  difficult  to  solve. 

For  these  reasons  we  tested  the  ACR  algorithm  on  PP  problems  for  which  P  is 
relatively  large.  We  did  not  attempt  to  solve  PP  problems  for  which  n  is  larger 
than  40  since  (i)  (as  explained  above)  the  number  of  variables  n  has  no  significant 
effect  on  the  number  of  iterations  in  the  covering  relaxation  algorithm  and  (ii) 
our  algorithm  for  solving  the  covering  problems  to  optimality  is  a  very  rudimentary 
implicit  enumeration  algorithm  which  requires  excessive  computational  time  to  solve 
covering  problems  with  more  than  40  variables. 

We  use  at  step  3  of  the  ACR  algorithm  Balas'  implicit  enumeration  algorithm 
to  solve  the  linear  covering  problem  to  optimality.  No  surrogate  constraints  or 
subgradient  optimization  techniques  are  employed.  However,  various  simplification 
and  elimination  rules  are  applied  to  the  constraint  matrix  of  the  covering  problem 
before  the  problem  is  solved.  Clearly,  the  sequence  of  CR  problems  solved,  either 
heuristically  or  to  optimality,by  the  ACR  algorithm  is  nested.  Therefore,  we 
always  start  the  search  for  an  optimal  solution  of  a  CR  problem  from  that  node 
in  the  solution  tree  corresponding  to  the  first  feasible  solution  of  the  previous 
CR  problem  which  was  solved  to  optimality  (if  any).  This  approach  certainly  reduces 
the  computational  time  for  solving  a  PP  problem.  However,  still,  most  of  the 
computational  time  for  solving  a  PP  problem  is  spent  on  solving  CR  problems  to 


optimality.  This  Is  evident  from  Figure  1  below,  which  presents  the  percentage 
of  total  CPU  time  required  by  the  ACR  algorithm  (Method  VA)  to  solve  covering 
problems  to  optimality  as  a  function  of  CPU  time  per  Iteration.  We  may  further 
conclude  from  Figure  1  that  the  overall  computational  time  for  solving  a  PP  problem 
can  be  significantly  reduced  by  employing  a  more  efficient  algorithm,  e.g.,  [2,4,5], 
for  solving  the  covering  problems  to  optimality. 


Figure  1 
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We  have  Investigated  the  computational  efficiency  of  the  following  methods 

for  solving  PP  problems. 

Method  I  -  This  is  the  covering  relaxation  method  studied  in  [10],  i.e.,  the 
ACR  algorithm  with  step  1  omitted.  The  initial  CR  problem  is  the 
unconstrained  problem  of  choosing  a  0-1  vector  x  minimizing  cx. 

At  each  iteration:  (i)  we  generate  one  covering  constraint  from 
each  violated  polynomial  constraint  using  the  ordinary  method, 
and  (ii)  we  solve  the  covering  problem  to  optimality. 

Method  II  -  Same  as  Method  I  except  that  step  1  of  the  ACR  algorithm  is  carried 
out. 

Method  III  -  Same  as  Method  II  except  that  the  initial  CR  in  step  0  of  the  ACR 
algorithm  is  generated  from  a  heuristic  solution  to  the  PP  problem 
as  explained  in  section  4. 

Method  IV  -  Same  as  Method  III  except  for  the  way  a  cover  is  generated  from  a 
violated  polynomial  constraint.  In  this  method  we  first  arrange 
the  terms  of  the  polynomial  inequality  in  decreasing  order  of 
a^/|N. 1,  and  then  the  implicit  enumeration  method  is  used  to  generate 
five  covers.  These  five  covers  are  the  first  five  encountered  in  the 
depth-first  search  of  the  solution  tree.  In  fact,  the  first  of  these 
five  covers  is  the  one  produced  by  the  weighted  method.  The  covering 
constraint  chosen  is  the  first  minimum -cardinality  cover  generated. 


Method  IVA  -  Same  as  Method  III  except  that  the  cover  generated  from  each  violated 
polynomial  Inequality  has  minimum  cardinality. 

Method  V  -  The  difference  between  Method  V  and  Methods  III,  IV  and  IVA  is  in  the 
way  we  generate  the  covering  constraints  from  the  violated  polynomial 
inequalities.  The  number  k  of  covers  generated  at  each 
Iteration  is  equal  to  the  number  of  violated  polynomial  inequalities. 
However,  those  k  covers  generated  are  the  ones  with  minimum  cardinality 


i.e.t  one  cannot  generate  another  covering  constraint  at  that 
iteration  whose  cardinality  is  strictly  smaller  than  the  cardinality 
of  any  of  these  k  covers. 

Method  VA  -  Same  as  Method  V  except  that  the  number  of  covers  generated  at 

each  iteration  depends  on  the  number  k  of  violated  polynomial  in¬ 
equalities.  Explicitly,  the  number  of  covering  constraints 
generated  equals  Max(k,[.2m]}. 

Method  VAA  -  Same  as  Method  VA  except  that  the  weights  D^(x)  or  a“e  not 

used  in  Heuristics  I,  II,  III,  IV  for  solving  the  CR  problem  (see 
remark  2). 

In  tables  1-6  below  we  use  the  following  notation: 

CPU  -  The  true  execution  time  in  seconds  required  to  solve  a  PP  problem 
excluding  the  time  required  to  generate  the  problem. 

OPT  -  The  number  of  covering  problems  solved  to  optimality. 

HEUR  -  The  number  of  covering  problems  solved  heuristically. 

COVERS  -  The  number  of  constraints  in  the  last  covering  problem  solved  to 

optimality. 

DENSITY  -  The  average  density  of  those  covering  problems  solved  to  optimality. 

EFFECTIVENESS  -  The  average  percentage  of  optimal  value  to  best  approximate  value 
for  all  CR  problems  that  were  solved  to  optimality. 


The  following  conclusions  can  be  drawn  from  the  above  tables. 

a)  From  Table  1  it  is  apparent  that  a  substantial  improvement  in  the  performance 
of  the  covering  relaxation  method  [10]  (i.e.  Method  I)  is  realized  with  the  intro¬ 
duction  of  step  1  of  the  ACR  algorithm  (i.e.  Method  II).  Attempting  to  generate 
cutting  planes  from  a  heuristic  solution  to  a  CR  problem  results  in  a  very  signifi¬ 
cant  decrease  in  both  the  number  of  covering  problems  solved  to  optimality  and  the 
computational  time.  Observe,  though,  that  the  introduction  of  step  1  has  increased 
both  the  number  of  iterations  (as  measured  by  the  number  of  covering  problems  solved 
heuristically  in  Method  II  and  to  optimality  in  Method  I)  and  the  average  number  of 
constraints  in  the  last  covering  problem. 

b)  When  the  initial  CR  problem  in  Method  II  is  generated  from  a  heuristic 
solution  to  the  PP  problem  (i.e.  Method  III)  additional  improvements  are  realized. 
Explicitly,  there  is  a  further  significant  reduction  in  both  the  number  of  CR 
problems  solved  heuristically  and  the  size  of  the  last  CR  problem,  particularly 
for  large  P. 

c)  Table  2  measures  the  effectiveness  of  employing  various  strategies  for 
generating  cutting  planes  on  computational  performance.  For  large  values  of 
P(P=17,20),  there  is  a  significant  decrease  in  the  CPU  time  and  the  number  of 

CR  problems  solved  heuristically  when  we  attempt  to  generate  covering  constraints 
with  low  cardinality.  Observe  that  there  is  hardly  any  difference  between  Method  IV 
in  which  we  choose  the  best  of  the  first  five  covers  generated  and  Method  IVA,  in 
which  we  generate  a  cover  with  minimum  cardinality  from  each  violated  polynomial 
inequality.  Of  course,  this  might  change  when  P  is  much  larger.  The  density  of 
the  CR  problems,  as  expected,  is  reduced  when  we  generate  minimal  cardinality  covers 
(I.e.  Method  V). 
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d)  From  Table  3  we  conclude  that  by  generating  at  each  iteration  at  least  .2m 
covering  constraints  with  minimum  cardinality  (I.e.  Method  VA).  both  the  number 
of  CR  problems  solved  to  optimality  and  the  CPU  time  are  significantly  decreased. 

e)  From  Table  4  it  is  evident  that  PP  problems  with  more  variables  in  a  term  are 
easier  to  solve. 

f)  From  Table  5  we  see  that  the  effectiveness  of  our  greedy  heuristics  is 
uniformly  superior  to  that  of  the  ordinary  greedy  heuristics,  in  which  the  weights 
are  not  incorporated  in  the  selection  criterion  of  variables  whose  values  are 
either  decreased  (Heuristics  I,  III)  or  increased  (Heuristics  II,  IV),  as  explained 
in  Remark  2.  This  superiority  results  in  a  better  computational  performance 

of  our  ACR  algorithm. 

g)  From  Table  6  we  conclude  that  increasing  P  -  the  maximum  number  of  terms 
in  a  polynomial  constraint  -  beyond  20  increases  significantly  the  CPU  time 
required  to  solve  a  PP  problem.  Indeed  the  CPU  time  appears  to  grow  exponentially 
in  P.  Observe  that  the  increase  in  the  number  of  covering  problems  solved  to 
optimality  is  more  moderate. 

We  used  the  data  in  Tables  1  and  6  to  estimate  the  regression  equation 
between  OPT  -  the  number  of  set  covering  problems  solved  to  optimality  and  P. 

For  method  1  the  regression  equations  were  found  to  be 

a)  n«40:  OPT  =  .27  +  .57P  .  s!«.03 

P 

b)  n-30:  OPT  -  -.66  +  .59P  . 

For  method  VA  the  regression  equations  were  found  to  be 

a)  n  •  40:  OPT  «  -.03  +  .17P  . 

b)  n  «  30:  OPT  •  -.37  +  .16P  ,  S5-.02 


where  is  an  unbiased  estimate  of  the  standard  deviation  of  the  coefficient  of 
P  in  the  various  regression  equations.  All  four  regressions  were  obtained  after 
eliminating  the  runs  for  P*2. 

By  comparing  the  appropriate  regression  equations  we  realize  that,  on 
the  average,  method  VA  solves  70*  less  covering 'problems  to  optimality  than 
method  I.  Further  observe  that  in  method  VA,  an  increase  in  the  number  of 
variables  from  30  to  40  has  increased,  on  the  average,  the  number  of  covering 
problems  that  need  to  be  solved  to  optimality  only  by  one  half  of  a  problem.  This  con 
firms  our  conclusion  based  on  the  computational  results  in  [10]  that  the  number  of 
variables  n  has  no  significant  effect  on  the  number  of  covering  problems  that 
need  to  be  solved  to  optimality  by  the  covering  relaxation  methods. 
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The  purpose  of  this  paper  is  to  present  an  accelerated  algorithm  for 
solving  0-1  Positive  Polynomial  (PP)  problems  of  finding  a  0-1  vector  x 
that  maximizes  cx  subject  to  f(x)  <  b,  where  f(x)  =  (f. (x))  is  an  m-vector 
of  polynomials  with  nonnegative  coefficients.  Like  our  covering  relaxation 
algorithm  (1979)  the  accelerated  algorithm  is  a  cutting-plane  method  in  which 
each  relaxed  problem  is  a  set  covering  problem  and  the  cutting  planes  are 
linear  covering  constraints.  However  by  contrast  with  other  cutting-plane 
methods  in  integer  programming  (including  our  original  method),  we  do  not 
solve  the  relaxed  problems  to  optimality  after  the  introduction  of  the 
cutting-plane  constraints.  Rather,  we  first  solve  each  relaxed  set-covering 
problem  heuristical ly  and  only  if  the  heuristic  solution  is  feasible  for 
PP  do  we  solve  the  relaxed  problem  to  optimality.  The  promise  of  such  an 
approach  stems  from  the  excellent  perfonnance  of  the  various  heuristic 
algorithms  for  solving  integer  programs.  Indeed  the  extensive  computational 
experimentation  we  performed  reveals  that  the  accelerated  approach  has  reduced 
significantly  both  the  number  of  covering  problems  solved  to  optimality  and 
the  computational  time  required  to  solve  a  PP  problem.  For  example  the 
average  computational  time  required  to  solve  a  PP  problem  with  40  variables 
and  an  average  of  10.5  terms  per  constraint  and  3  variables  per  term  was  reduced 
using  the  accelerated  method  from  84.7  to  25.8  seconds  while  the  average  number 
of  covering  problems  solved  to  optimality  was  reduced  fran  11.5  to  3.8 


